Stat 538 Project: Implementation of Maximum Entropy Discrimination with a Linear Discriminant Function

نویسنده

  • Jonathan Gruhl
چکیده

For this project, our goal was to implement Maximum Entropy Discrimination (MED) with a linear discrimination function for binary classification purposes. This technique was presented by Jaakola, Meila, and Jebara in “Maximum Entropy Discrimination” (1999). Their paper provides a generalized framework for discrimination that relies on the maximum entropy principle. One of the interesting aspects of MED is its consideration of distributions over parameters in the discriminative model. Thus, instead of finding a single optimal setting of paramters, MED estimates a distribution over the parameters and this distribution is chosen to satisfy constraints in a manner that is non-prejudiced or does not imply that possession of information not present. We apply this technique with a linear discriminant function first to a common benchmarking dataset for discrimination techniques and second to a classification problem of interest to the author.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Discrimination of Golab apple storage time using acoustic impulse response and LDA and QDA discriminant analysis techniques

ABSTRACT- Firmness is one of the most important quality indicators for apple fruits, which is highly correlated with the storage time. The acoustic impulse response technique is one of the most commonly used nondestructive detection methods for evaluating apple firmness. This paper presents a non-destructive method for classification of Iranian apple (Malus domestica Borkh. cv. Golab) according...

متن کامل

Discrimination of teachers with high and low job burnout on the basis of organizational commitment and work ethic

Job burnout is the person's reaction to interpersonal stressors in the workplace. The aim of the present study was the discrimination of teachers with high and low job burnout on the basis of work ethic and organizational commitment. The research method was causal-comparative. The population consisted of all male and female employed teachers with different educational levels in the 2016-2017 ac...

متن کامل

A New Quadratic Classifier Applied to Biometric Recognition

In biometric recognition applications, the number of training examples per class is limited and consequently the conventional quadratic classifier either performs poorly or cannot be calculated. Other non-conventional quadratic classifiers have been used in limited sample and high dimensional classification problems. In this paper, a new quadratic classifier called Maximum Entropy Covariance Se...

متن کامل

A new topological entropy-based approach for measuring similarities among piecewise linear functions

In this paper we present a novel methodology based on a topological entropy, the so-called persistent entropy, for addressing the comparison between discrete piecewise linear functions. The comparison is certified by the stability theorem for persistent entropy. The theorem is used in the implementation of a new algorithm. The algorithm transforms a discrete piecewise linear function into a fil...

متن کامل

A General Methodology for Simultaneous Representation and Discrimination of Multiple Object Classes

In this paper we address a new general method for linear and nonlinear feature extraction for simultaneous representation and classi cation. We call this approach the maximum representation and discrimination feature (MRDF) method. We develop a novel nonlinear eigenfeature extraction (NLEF) technique to represent data with closed-form solutions and use it to derive a nonlinear MRDF algorithm. R...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2008